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User Control and Activation of Watermark Enabled Objects 

Related Application Data 

This patent application is a continuation in part of US Patent Application No. 
09/633,587, filed August 7, 2000, which is a continuation in part of US Patent 
5 Application No. 09/343,104, filed June 29, 1999. US Patent Application No. 09/343,104 
claims priority from US Provisional Application No. 60/134,782, filed May 19, 1999. 
This patent application is also a continuation in part of US Patent Application No. 
09/571,422, filed May 15, 2000, which claims priority to US Provisional Application No. 
60/134,782, filed May 19, 1999. These patent applications are hereby incorporated by 
10 reference. 

The subject matter of the present application is related to that disclosed in US 
Patent 5,862,260, and in co-pending applications 09/503,881, filed February 14, 2000, 
which are hereby incorporated by reference. 


15 Technical Field 

The invention relates to multimedia signal processing, and in particular relates to 
hiding auxiliary information in media signals like audio, video and image signals. 

Background and Summary 

Digital watermarking is a process for modifying physical or electronic media to 
20 embed a machine-readable code into the media. The media may be modified such that 
the embedded code is imperceptible or nearly imperceptible to the user, yet may be 
detected through an automated detection process. Most commonly, digital watermarking 
is applied to media signals such as images, audio signals, and video signals. However, it 
may also be applied to other types of media objects, including documents (e.g., through 
25 line, word or character shifting), software, multi-dimensional graphics models, and 
surface textures of objects. 
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Digital watermarking systems typically have two primary components: an 
encoder that embeds the watermark in a host media signal, and a decoder that detects and 
reads the embedded watermark from a signal suspected of containing a watermark (a 
suspect signal). The encoder embeds a watermark by altering the host media signal The 
5 reading component analyzes a suspect signal to detect whether a watermark is present. In 
applications where the watermark encodes information, the reader extracts this 
information from the detected watermark. 

Several particular watermarking techniques have been developed. The reader is 
presumed to be familiar with the literature in this field. Particular techniques for 

10 embedding and detecting imperceptible watermarks in media signals are detailed in the 
assignee's co-pending application serial number 09/503,881 and US Patent 5,862,260, 
which are hereby incorporated by reference. 

The invention provides methods and systems for associating watermark enabled 
objects with machine behaviors. In this context, machine behaviors refer to actions by 

1 5 devices or systems in response to a triggering event. Examples of these behaviors 
include fetching a web page, opening an email client to send an email to a specific 
person, initiating a phone or video conference call, etc. In the detailed description to 
follow, a watermark system enables users to associate machine behaviors with objects 
through a watermark embedded in the objects. The decoding of the watermark initiates a 

20 process for triggering the machine behaviors associated with the watermarked object. 
While the detailed description focuses on an implementation for stickers as a class of 
watermark enabled objects, the system and related methods apply to other forms of 
watermark enabled objects. 

Further features will become apparent with reference to the following detailed 

25 description and accompanying drawings. 
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Brief Description of the Drawings 

Fig. 1 is a system diagram depicting a system for associating watermark enabled 
objects with machine behaviors, and for triggering those behaviors in response to 
decoding watermarks. 

5 Fig. 2 is a diagram depicting a variant of the system shown in Fig. 1 showing 

system components for enabling users to perform watermark identifier registration and 
embedding. 

Detailed Description 

The following description details a system and related methods for associating 

10 watermark enabled objects with machine behaviors. To illustrate the system, the 

description focuses on an example of watermark enabled stickers. As noted, the system 
applies more broadly to watermarking both physical and electronic objects, hi particular, 
aspects of the system may be used for watermarking media signals like images, video and 
audio, as well as applying watermarks to physical objects. Watermarks may be applied to 

1 5 physical objects by placing a watermarked image on a physical object, by modulating the 
surface topology of the object, etc. See US Patent 5,862,260, for more information about 
watermark embedding of and decoding from physical and electronic objects. 

Stickers in all their varieties have found an enduring place in our society. From 
the workplace (Post-It ® brand message notes), to kids in a classroom, stickers have an 

20 inherit value associated with them, whether it be functional (seals, labels, etc.) or just to 
identify yourself with a particular affinity group (bumper stickers on cars). By placing a 
watermark on stickers they can be used in novel ways. By encoding a set of stickers with 
a watermark during production, specific machine behaviors can be assigned to them. 
These behaviors can be associated or even possibly changed by anyone from the 

25 manufacturer through the distributor, all the way to the end-user. In addition, the users 
can create their own watermark enabled stickers by creating an image, embedding a 
watermark in it, and associating the watermark with one or more machine behaviors. 
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These behaviors may include, but are not limited to the following: 

• Taking the user to a web-site linked to the watermark via a network 
address of the web-site or index to the network address. 

• Opening an email client to email to a specific person (e.g., a person whose 
email address is stored in the machine behavior description associated 
with the watermark). 

• Launching the user into an Interframe Relay Chat (IRC) session that other 
people with the same sticker can participate in. 

• Authenticating the user as part of a process of accessing a network 
resource, such as account information or access to a computer network. 

• Authentication the user in an electronic commerce transaction performed 
on a computer network. 

• Sending an electronic card. 

• Placing a phone or video-conference call. 

• As props in a computer game. For example, the prop is a multi-sided, or 
multi-faceted object, where each side or facet has a watermarked image 
conveying a different message used to control the game. The computer 
game includes a watermark decoder for extracting the messages from 
image frames captured of the prop. The message may directly carry the 
message or act as an index to a more detailed game instruction in a 
database, such as an instruction that changes over time based on changes 
to the corresponding database entry by the user or game manufacturer. 

• As a visual aide for disabled users. 

• Anywhere where machine vision is not feasible. 

In each of the above applications, the watermark carries information that links the 
watermarked object (e.g., sticker) with a machine behavior. To trigger this behavior, a 
watermark decoder application captures an image or images of the watermarked sticker, 
extracts the watermark, and uses information embedded in the watermark to determine 
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the associated machine behavior. The watermark decoder then takes action to initiate the 
machine behavior associated with the watermark. 

For some applications, it is useful to enable the user to control the behavior 
associated with a watermarked object. This type of management may be handled by 
5 creating accounts for users and providing access to the accounts via some authentication 
method (email, passwords, etc.). For a number of reasons, these access methods can be 
problematic (losing passwords, asking kids for their email addresses, etc.). As an 
alternative, watermarks may be used to manage the process of associating behaviors with 
a watermarked object. 

10 For example, in the scenario where a user wants to assign behaviors to a set of 

watermarked stickers they have received, they can hold up the first sticker (or its 
packaging), and be taken to a registration application to activate the stickers in the pack. 

Fig. 1 is a system diagram depicting a system for associating watermark enabled 
objects with machine behaviors, and for triggering those behaviors in response to 

15 decoding watermarks. The system depicted in Fig. 1 is implemented on a computer 
network, namely, the Internet. The user accesses the system via a computer 100 
connected to the Internet. The computer broadly encompasses a variety of devices, such 
as Personal Computers, set-top boxes, personal digital assistants, Internet appliances, set- 
top boxes, telephones (including wireless devices), audio and video players, and imaging 

20 devices (CCD or CMOS cameras, camcorders, printers, fax machines, copiers, etc.). The 
computer is connected to an image capture device 102, such as a PC camera or scanner, 
and includes watermark decoder software for decoding watermarks from images captured 
from the image capture device. 

The system architecture shown in Fig. 1 includes a system (106) for managing the 

25 process of assigning behaviors to watermarked objects as well as a database management 
system (108) for initiating behaviors in response to decoding watermarks from the 
objects. These two systems may be integrated or implemented separately. In the 
application depicted here, the registration system and database management system are 
accessible via a network interface using standard network technology, including HTML, 

30 XML, and TCP/IP. A watermark embedding system has previously embedded 
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watermarks carrying watermark identifiers into stickers. The stickers (or packages of 
them) also include a registration identifier used to activate the behaviors associated with 
them. 

The registration system maintains a registration database including records of the 
5 registration identifiers and corresponding watermark identifiers. The registration 

identifiers are serialized numbers corresponding to the watermarked stickers or packages 
of them. The watermark identifiers are a form of object identifiers that are encoded into 
the watermarks on the corresponding stickers. The registration system maintains a 
registration database 110 of data records indicating the watermark identifiers associated 

10 with each registration identifier. When a user selects a behavior to be associated with a 
watermarked object via the registration system, the registration system sends an update 
1 12 to a behavior database 114 specifying the behavior to be associated with a 
corresponding watermark identifier. In response, the database management system 108 
updates its database to include a record that indicates the behavior associated with a 

1 5 particular watermark identifier. 

The database management system 108 is also responsible for supporting machine 
behavior associated with a watermarked sticker in response to detection of the watermark 
on the sticker. It has a network interface for communicating with other computers over 
the Internet. In particular, it receives requests in the form of an XML packet from a 

20 watermark decoding computer, extracts a watermark identifier from the packet and looks 
up the associated behavior or behaviors in the behavior database. It then initiates the 
associated behavior. The details of how this behavior is carried out depend on the 
application and type of behavior. 

In a typical registration process, the user accesses the registration system via a 

25 registration web site, which presents an HTML interface to the users' computers. The 

user may fetch the HTML pages of this interface using an Internet browser or application 
program, like the watermark decoder application executing on the computer 100. This 
interface enables the user to enter a registration identifier to start a process of associating 
behaviors with watermark identifiers embedded in watermarked stickers. In response to a 

30 registration identifier, the registration system returns a page that enables the user to 
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specify the behavior. In the case where the behavior is linking a watermarked sticker to a 
web site, the user specifies the network address of the web site, such as a URL or IP 
address. In the case where the behavior is linking a watermarked sticker to an email 
message, the user specifies the email address of the email recipient. 
5 As noted above, there are many other types of watermark enabled behaviors. 

They can be classified as providing information to the watermark decoding computer, 
launching some software program or machine action, or a combination of both. Table 1 
below gives some examples of behaviors, and the related information and actions. 

Table 1 

10 


Behavior Type 

Information Returned to 
UpcoHinp Commitpr 

Associated Machine or 

SkA'Fl'Wfii'A Aptfrmc 

linking to web site 

URL, web page 

launching browser on client 
to fetch/render web page at 
URL 

opening an email client 

email address of target 
recipient 

launching email client and 
populating address field 
with target recipient 

starting a chat session 

address of chat session 

launching chat application 
(watermarks on the stickers 
can be designed such that 
only those holding the 
stickers can gain access to 
the chat session, each by 
showing the sticker to his or 
her watermark decoder 
enabled camera) 
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accessing account 
information or other 
network resources 

address of account 
information 

launching of browser 
application to access 
account information 
through a web interface; 
supplying user 
authentication information 
from watermarked object 
and/or from user (user 
password, user name, log 
on, etc.) 

sending an electronic card 

card template 

launching client application 
to enable the user to design 
me cara ana aua personal 
message, launching email 
application to send 
electronic card (or link to 

plpptrrvnir* pjiiyI^ 

placing a phone or video 
conference call 

phone number or IP address 
of destination 

launching application to 
initiate phone call over the 
internet or telephone 
network 

props in an interactive 
computer game 

identifier of prop, and 
possibly other context 
information, such as game 
player holding the prop, etc. 

game application receives 
prop and context 
information and responds 
accordingly 
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visual aid for disabled users 

returns information in the 
form oi graphics, audio, or 
video (may provide address 

Ul dUUlU Ul VlUCU CUlllGllL dl 

an audio or video server on 
the Internet) 

browser, or other media 
player applications render 
the information (such as the 
s ireaimng meaia ) on me 
decoding computer 

machine control 

machine instruction 

machine or software 
executes instruction 


For a given application, the registration system provides information to the user to 
enable the user to select the behavior and provide pertinent information, such as URL, IP 
address, phone number, email address, content file (e.g., audio, image or video file), etc. 
5 The registration system formulates a description of the behavior, associates it with the 
watermark identifier specified by the user, and creates an update 1 12 to the behavior 
database. 

The user then uses the stickers or shares them with friends. To trigger the 
behavior of a sticker, a user captures an image of the sticker with an image capture device 

10 102 using a watermark decoder application 104 executing on the computer 100. The 
watermark decoder extracts the watermark identifier from a watermark embedded in the 
image on the sticker. It then sends the watermark identifier to the database management 
system 108 via the Internet, which in turn, looks up the associated behavior. The 
database management system then triggers the associated behavior by sending 

15 information, or instructions back to the decoding computer. The decoding computer 

renders the information, and launches a software or other machine action associated with 
the instructions returned from the database. The database need not be implemented in a 
remote computer. For example, the database may be implemented in the watermark 
decoding computer or device. 

20 As an enhancement to the registration process, objects may carry watermarks that 

automatically link the user to the registration web site. For example, one side of the 
sticker 1 16 or its packaging 118 may contain a watermark with the network address or an 
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index to a network address of the registration web site. The user shows this part of the 
sticker or packaging to the image capture device. The watermark decoder extracts the 
watermark and looks up the network address in the behavior database, and launches a 
browser to fetch the registration web site. The watermark may also carry the registration 
5 identifier. Li this case, the registration web site can tailor the web page returned to the 
user to be specific to the watermarked object. If the user or someone else previously 
associated a behavior with the sticker, the registration web site returns the current status 
associated with the registration identifier and the behaviors associated with the 
watermarked objects linked to that registration identifier. To get detailed information 

1 0 about particular watermarked objects during the registration process, the user can show 
the watermarked object to a camera, and use a watermark decoder to extract the 
watermark identifier and supply it to the registration system. In response, the registration 
system takes the watermark identifier, queries the behavior database via the database 
management system, and returns a description of the associated behaviors. This approach 

15 provides a simple and automated process of activating watermark enabled objects. 

For more information about an object identifier registration system and system for 
linking objects with machine behaviors, see US Patent No. 09/571,422, which is hereby 
incorporated by reference. 

In some applications, the user may wish to create his or her own watermarked 

20 objects. Fig. 2 illustrates a system that enables users to assign watermark identifiers to 
corresponding behaviors and objects and update the behavior database. In this particular 
system, the user's computer includes a watermark embedder application (120). However, 
the embedder application may be implemented on a separate computer, such as a server 
on the Internet accessible via a client application on the user's computer 100. In the 

25 former case, the user embeds the watermark into the desired image content on his 

computer. In the latter case, the client supplies the image content to the server, which 
performs watermark embedding and returns watermarked images to the client. In both 
cases, the watermarked objects are created by printing the watermarked images on 
objects. 
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The process begins when an embedder 120 creates a registration request. In the 
system shown in Fig. 2, the embedder 120 is a software application running on the 
computer 100. The embedder formulates the request in a request file. The system 
provides a template for the request file. The request file specifies the number of 
5 watermark identifiers requested and the names of the media files to be embedded. The 
file may also specify the behaviors to be associated with each watermark identifier. 
Alternatively, the user can specify the behaviors to be associated with the watermark 
identifier at a later time using the methods described in this document. In the case where 
embedding is performed on a server as opposed to the user's computer, the request file 
10 may also include the media file (e.g., an image file) carrying the content to be embedded 
with the watermark identifier. 

Next, the embedder connects, via a network connection, to the registration system 
106. In particular, it connects to a registration web site via an Internet connection. This 
web site requests the embedder' s username and password to authenticate it. 
1 5 The user enters his username and password via a user interface displayed on the 

PC 100 and submits them to the web site for authentication. 

Upon authentication, the registration website 106 returns an HTML page 
presenting the embedder with a user interface screen that allows the user to locate the 
embedder's registration request file for uploading to the web site. The user then enters a 
20 command to instruct the embedder to upload the selected request file. 

The embedder provides the information required to locate the file on the 
embedder's computer and submits it for upload. 

The registration request file is uploaded into a registration loader program 122. 

The registration loader 122 performs a quick scan of the uploaded registration 
25 request file and reports back to the embedder any errors in format that it detects. If there 
are errors, the file is not processed. 

If the registration request file is properly formatted, the embedder receives a 
confirmation from the registration website 106 that the request file has been successfully 
uploaded and will be submitted for processing by the registration loader 122. 
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The embedder may now either submit a new registration request file or logoff of 
the registration web site 106. 

The registration loader 122 uses the information contained in the embedder's 
uploaded registration request file to automatically allocate (register) watermark 
5 identifiers in a registration database 1 1 0. The identifiers are in the form of serial 

numbers. Once this process is completed, the registration loader 122 initiates a request to 
a registration extractor 124 for these new registration entries. 

Upon receipt of a request, the registration extractor 124 accesses the registration 
database 110 and creates embedder control files for each of these new registered 
1 0 watermark identifiers (e.g., serial numbers). 

Upon completion of this process, the registration extractor 124 process sends the 
embedder control file(s) back to the embedder via Internet e-mail In the event that the 
embedder is server based, the extractor sends the control file(s) (or a pointer to them) to 
the embedder server 126, which may be integrated with the registration system or 
15 implemented at a different Internet site. The extractor 124 also sends an update 128 to 
the behavior database 1 14 to create database records associating each of the watermark 
identifier with a behavior. 

Once the embedder 120 has received the embedder control file(s), it uses these 
file(s), along with the media file(s) (in this case, image files) and a set of embedding 
20 instructions to the embedder 120 to instruct the embedder to automatically embed the list 
of watermark serial numbers included in the embedder control file(s) into the listed media 
files, producing a set of watermark-embedded media files. In the case where the 
embedder is server based, the client executing on the PC 100 uploads the media files to 
be embedded to the embedder server, either directly or as part of the registration process 
25 (e.g., as part of the request file). The embedder server then returns the watermarked files 
to the computer 100 via e-mail or other network file transfer protocol. 

For detailed disclosure describing how to embed watermarks in media signals, 
including images, audio, and video, see US Patent 5,862,260, and co-pending application 
09/503,881, filed February 14, 2000, incorporated above. 
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The embedder may create watermarked objects by printing watermarked images 
on objects, such as stickers, documents, etc. The embedder sends the watermarked image 
to a printer 128, which in turn, prints the image on an object. 

The above system provides a mechanism for linking objects to machine 
5 behaviors. As noted previously, this mechanism applies to both physical objects, like 
stickers and packaging, and electronic objects, like image, audio and video signals. It 
also applies to other forms of machine readable signal carriers that can be applied to such 
objects, including bar codes, magnetic stripes, Radio Frequency tags, integrated circuit 
chips, organic transistors, etc. These machine readable carriers can be used in the same 

10 way that watermarks are used in the example of watermarked enabled stickers above. 

While these technologies provide a mechanism for linking objects to machine 
behaviors, there is a need for a tool that explicitly facilitates the creative coordination 
between the object and the behavior linked to it. The linking process results in a 
potentially complex database structure which not only embodies the fundamental object 

15 to behavior link, but also might include a hierarchy of delivered responses as a function 
of user implicit or explicit requests. Or, said in a quite different way, the creative process 
of linking an object to complex data-driven responses is itself a creative endeavor all to 
itself, involving thinking through the various different reactions that users will want and 
expect when using an object as a portal. The artist who is tasked with creating the 

20 choreography between an object and a simple or complex machine behavior will need 
explicit assistance from well designed tools, resulting in a database record which 
memorializes that creativity as an active element within a connectivity system described 
in this document and US Patent Application 09/571,422. The immediate creative output 
is a database structure. The long term creative output is the active use of that structure as 

25 a stimulus-response hub. 

Whether a link design tool be web-server based, or whether it be a stand-alone 
application similar in kind to an Adobe Photoshop or a Quark Express, it is possible to 
offer visual metaphors to a creative designer which literally presents that designer with an 
image of the to-be-linked object along with explicit visual links to one or more data 

30 responses. 
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One embodiment of this tool for linking printed objects to web pages is a local 
computer application which presents an image of a printed object on the left side of an 
application's window pane and the image of a web page on the right side of the 
application pane. The images of the printed objects may be stored locally or fetched from 
5 a remote device (e.g., a content database) and rendered to the left side of the screen. 
Similarly, the web pages may be stored locally or downloaded from web sites on the 
Internet or some other network. The user interface of the application displays a control 
such as a button, labeled, "Connect", "Link" or some other active word representing the 
process of associating an object with a corresponding machine behavior. The user, 

1 0 having browsed through a series of objects to be linked, and browsed through a series of 
potential web site destinations, finding the best "matched-pair", pushes the button and off 
this relational link goes into a queue waiting to "go live", or, in other words, a temporary 
record is stored for a candidate link to be sent to the behavior database of the linking 
system described previously. A user can perform multiple links per session, queueing 

15 them up as they go, reviewing the queue at some point in time, then directing the links to 
become active at the behavioral database, as described previously and in the referenced 
documents. 

An extension begins by generalizing the single printed item to be an icon or visual 
analogy to a related set of printed material Graphical user interface methods can be 

20 employed to move, manipulate, view and otherwise process this icon in a fashion familiar 
to creative professionals. Likewise, surrounding this generalized icon representing the 
object(s) to be printed can be a whole series of icons representing a variety of potential 
data-delivered responses that are possible links. Existing web pages, placeholders for 
web pages to be designed, streaming media icons, Java application icons, "links to links" 

25 icons wherein a given response may explicitly point to a menu of actions presented to the 
end user, (end user = consumer doing the linking). This list of possible responses is 
incomplete but nevertheless representative of graphically displaying the possible 
relationships between printed material and data responses. 

As in the baseline case, various relationships can be created between objects and 

30 responses, ultimately stored into a queue. The actual functionality and quality assurance 
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of the links could be tested in the process. Once the creative artist is satisfied with their 
link or set of links, the queue can be sent to go live at the behavior database and further 
double checks on quality performed. 

Concluding Remarks 

5 Having described and illustrated the principles of the technology with reference to 

specific implementations, it will be recognized that the technology can be implemented in 
many other, different, forms. To provide a comprehensive disclosure without unduly 
lengthening the specification, applicants incorporate by reference the patents and patent 
applications referenced above. 

10 While the invention is illustrated with reference to watermarked stickers, aspects 

of the invention apply to other object types including media signals like audio and video. 
There are number of different watermark embedding and decoding methods that may be 
used. The watermark embedding process may modulate features of a signal in the time, 
frequency, spatial or some other transform domain of the signal to be watermarked. 

15 In addition to an object identifier, the watermark may be used to convey other 

information, such as an index to related metadata, rendering control instructions, etc. For 
example, the watermark can carry a network address or index to a network address to link 
the watermarked signal to a network resource such as a related web site. 

Other machine readable codes may be embedded in an object and used to link the 

20 object to a machine behavior. Some examples include bar codes, magnetic stripes, RF 
tags, etc. The devices and methods used to extract an identifier from the machine 
readable code differ, yet the process for registering identifiers and associating behavior 
with objects may be similar. 

The methods, processes, and systems described above may be implemented in 

25 hardware, software or a combination of hardware and software. For example, the 

auxiliary data encoding processes may be implemented in a programmable computer or a 
special puipose digital circuit. Similarly, auxiliary data decoding may be implemented in 
software, firmware, hardware, or combinations of software, firmware and hardware. The 
methods and processes described above may be implemented in programs executed from 
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a system's memory (a computer readable medium, such as an electronic, optical or 
magnetic storage device). 

The particular combinations of elements and features in the above-detailed 
embodiments are exemplary only; the interchanging and substitution of these teachings 
with other teachings in this and the incorporated-by-reference patents/applications are 
also contemplated. 
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We claim: 

L A system for enabling a user to associate a machine behavior with an object 
comprising: 

a registration system enabling a user to specify a machine behavior to be 
5 associated with an object via an object identifier; 

a database management system in communication with the registration system for 
receiving and maintaining records associating object identifiers with machine behaviors, 
wherein the database management system is operable to receive object identifiers and in 
response, to initiate the machine behavior or behaviors associated with the object 
10 identifiers. 

2. The system of claim 1 wherein the registration system includes a network 
interface that enables users to associate behaviors with object identifiers from remote 
client computers. 

15 

3. The system of claim 1 wherein the object identifiers comprise watermark 
identifiers which are embedded in watermarks on corresponding objects. 

4. The system of claim 3 wherein the objects are watermarked stickers. 

20 

5. The system of claim 3 wherein the machine behavior includes fetching a web 
site relating to an object carrying the object identifier. 

6. The system of claim 1 including a user interface that enables a user to view an 
25 image of an object along with an image of a behavior to be associated with the object, the 

user interface including a control that enables the user to associate the object with the 
behavior, and the user interface being operable to communicate a database structure to 
the database management system specifying an object identifier for the object and a 
description of the behavior. 
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7. The system of claim 6 wherein the object identifier is embedded into the object 
using a watermark. 

8. The system of claim 6 wherein the behavior is fetching a web page. 

5 

9. The system of claim 8 wherein the database management is responsive to a 
watermark identifier extracted from a watermarked object by a watermark decoding 
computer to initiate a process of directing a web page to the watermark decoding 
computer. 

10 

10. A method for enabling a user to associate a machine behavior with an object 
comprising: 

presenting a user interface enabling a user to specify an object and a machine 
behavior to be associated with the object; 
1 5 receiving a specification of an object and a behavior to be associated with that 

object; and 

updating a database with an entry specifying an object identifier of the object and 
the behavior, wherein the database is operable to initiate the behavior in response to 
receiving an object identifier decoded from machine readable code on the object. 

20 

11. The method of claim 10 wherein the specification of the object includes a 
registration identifier provided on the object or packaging of the object. 

12. The method of claim 1 1 wherein the registration identifier is embedded in a 
25 watermark on the object. 

13. The method of claim 12 wherein the user interface is launched in response to 
decoding the watermark on the object. 
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14. The method of claim 13 wherein the user interface is a web based interface, 
and the user establishes a connection with the web based interface automatically in 
response to decoding the watermark on the object. 

15. A computer readable medium having software for performing the method of 
claim 10. 

16. A watermark enabled object associated with a machine behavior via a 
watermark embedded in the object, wherein the machine behavior is triggered in response 
to decoding the watermark in the object. 

17. The object of claim 16 wherein the object is a sticker. 

18. The object of claim 16 wherein the object is a prop in a computer game, and 
the prop supplies information to the computer game by conveying the information in a 
message embedded in a watermark on the prop. 

19. The object of claim 16 wherein the object has two or more facets, each facet 
being embedded with a different watermark message used to control the game. 

20. The object of claim 18 wherein the message includes an index to a database 
entry where information for controlling the gave is stored. 

21. The object of claim 16 wherein the machine behavior includes launching an 
email program and an email directed to a destination associated with the object via the 
watermark. 

22. The object of claim 16 wherein the machine behavior includes launching an 
Internet chat session. 
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23. The object of claim 16 wherein the machine behavior includes placing a 
telephone call to a destination associated with the object. 


5 
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User Control and Activation of Watermark Enabled Objects 

Abstract of the Disclosure 

Methods and systems for associating watermark enabled objects with machine 
behaviors. Machine behaviors refer to actions by devices or systems in response to a 
5 triggering event. Examples of these behaviors include fetching a web page, opening an 
email client to send an email to a specific person, initiating a phone or video conference 
call, etc. A registration system enables users to associate machine behaviors with objects 
through a watermark embedded in the objects. The decoding of the watermark initiates a 
process for triggering the machine behaviors associated with the watermarked object. 
10 While the disclosure describes an implementation for stickers as a class of watermark 
enabled objects, the system and related methods apply to other forms of watermark 
enabled objects, including both electronic and physical objects. 
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COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 
I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and 
joint inventor (if plural names are listed below) of the subject matter which is claimed and for which a 
patent is sought on the invention entitled USER CONTROL AND ACTIVATION OF WATERMARK 
ENABLED OBJECTS, the specification of which 

[x] is attached hereto. 

[ ] was filed on as Application No. . 

[ ] was described and claimed in PCT International Application 

No. , filed on , and as amended 

under PCT Article 19 on (if applicable). 

[ ] and was amended on (if applicable). 

[ ] with amendments through (if applicable). 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to patentability as defined in Title 
37, Code of Federal Regulations, § 1 .56. If this is a continuation-in-part application filed under the 
conditions specified in 35 U.S.C. § 120 which discloses and claims subject matter in addition to that 
disclosed in the prior copending application, I further acknowledge the duty to disclose material 
information as defined in 37 CFR § 1.56 which occurred between the filing date of the prior application and 
the national or PCT international filing date of the continuation-in-part application. 

I hereby claim foreign priority benefits under Title 35, United States Code, § 1 19(a)-(d) of any 
foreign application(s) for patent or inventor's certificate or of any PCT International application(s) 
designating at least one country other than the United States of America listed below and have 
also identified below any foreign application(s) for patent or inventor's certificate or any PCT International 
application(s) designating at least one country other than the United States of America filed by me on the 
same subject matter having a filing date before that of the application(s) on which priority is claimed: 

Prior Foreign Application(s) Priority 

Claimed 

[] [] 

(Number) (Country) (Day/Month/Year Filed) Yes No 

I hereby claim the benefit under Title 35, United States Code, § 1 1 9(e) of any United States 
provisional application(s) listed below: 

60/134,782 May 19, 1999 

Application Number Filing Date 
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I hereby claim the benefit under Title 35, United States Code, § 120 of any United States 
application(s) or § 365(c) of any PCT International appiication(s) designating the United States, listed 
below and, insofar as the subject matter of each of the claims of this application is not disclosed in the 
prior United States or PCT International application in the manner provided by the first paragraph of Title 
35, United States Code, § 1 12, 1 acknowledge the duty to disclose material information as defined in Title 
37, Code of Federal Regulations, § 1 .56(a) which occurred between the filing date of the prior application 
and the national or PCT International filing date of this application: 


09/633,587 8/7/00 Pending 


09/343,104 

6/29/99 

Pending 

09/571,422 

5/15/00 

Pending 

60/134,782 

5/19/99 

Abandoned 

(Application No.) 

(Filing Date) 

(Status: patented, 


Pending, abandoned) 


The undersigned hereby authorizes the U.S. attorney or agent named herein to accept and follow 

instructions from as to any action to be taken in the Patent and Trademark Office regarding 

this application without direct communication between the U.S. attorney or agent and the undersigned. In 
the event of a change in the persons from whom instructions may be taken, the U.S. attorney or agent 
named herein will be so notified by the undersigned. 

I hereby appoint the following attorney(s) and/or agent(s) to prosecute this application, to file a 
corresponding international application, and to transact all business in the Patent and Trademark Office 
connected therewith: 


William Y. Conwell 
Joel R. Meyer 
Thomas M. Horgan 
Elmer Galbi 


Reg. No. 31,943 
Reg. No. 37,677 
Reg. No. 33,183 
Reg. No. 19,761 


Address all telephone calls to Joel R. Meyer at telephone number (503) 885-9699. 
Address all correspondence to: 


Joel R. Meyer 

DIGIMARC Corporation 

Digimarc Corporation 

19801 SW 72nd Avenue, Suite 250 

Tualatin, OR 97062 


I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements were 
made with the knowledge that willful false statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued thereon. 


Full Name of Sole or First Joint Geoffrey B. Rhoads 

Inventor: 

Inventor's Signature 

Date 

Residence: West Linn, Oregon 
Citizenship: USA 

Post Office Address: 2961 SW Turner Road, West Linn, Oregon 97068 
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Full Name of Second Joint Inventor: Tony F. Rodriguez 

Inventor's Signature 

Date 

Residence: Portland, Oregon 
Citizenship: USA 

Post Office Address: 3104 NE 31 st Avenue, Portland, Oregon 97212 

Full Name of Third Joint Inventor: Tyler J. McKinley 

Inventor's Signature 

Date 

Residence: Lake Oswego, Oregon 
Citizenship: USA 

Post Office Address: 1 7020 SW Tracy Avenue, Lake Oswego, OR 97035 
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